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Automatic setting of ^Living Lights' depending on the 
color information inherent in the content 



This invention is primarily concerned with the setting of ambient Ught - center lights 
around a TV based on the content that is being currently watched by the user, BasicaUy 
average color information is extracted from the borders of the content and mapped onto 
the LED space. Next, the mapped color information is used to set the LED units around 
the TV thereby creating light effects synchronous to the watched content. 

The general steps that need to be followed to realize the invention are as follows: 

1) Acquire a video signal and decode the video signal into a set of frames 

2) Extract color information from the content (frames) around the boundary 

3) Transfonn the color information of the content from the RGB space onto the color 
space of the LEDs and the displays color space. 

4) Transmit the transformed color inforaiation of the content to the LED units so as 

to trigger them. 

Steps ( I) and (4) are straightforward and are not forther discussed below. 
The current setup for an ambient lighting system is as shown below: 
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Ught speakers 



Centre Ught 
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Figure 1. Setup of Light Units 



In the above figure there are 11 independently controllable LED lighting umts. There are 
four light speakers, one unit under the couch ('Sub-light') and 6 LED units on the center- 
light The center-light is a little bit special, m the way it is set-up - it has 6 mdependently 
controlled, Ught units behind the four sides of the Flat TV and is shown below: 



Figure 2: Setup of light units around the TV 



In the above figure LI to L6 refer to the light units around TV. The figure also shows a 
single frame of the content displayed on the TV. Each Ught unit located at back of the TV 
is triggered by extracting the average color information from each re^on - Rl to R6. 
Each region has a width of 100 pixels. As an example if the size of the firame were 
720x576 pixels, then the size of Rl, R2, R4 and R5 would be 360x100 pixels. Smularly 
size of R3 and R6 would be 100x376 pixels. 

Since the video signal is decoded into a set of frames (25 frames per second) in the RGB 
color space, the resulting image size would be 720x576x3 which is a 3D matrix where 
each 2D matrix of size 720x576 corresponds to each one of the Red, Green and Blue 
channels. 

The average color information for each region of the channel is extracted by summing up 
all the pixels in that region and dividing by the total number of pixels in that region for 
each channel. The equation for the extraction of the average color information for each 
region for one channel is shown below: 
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If the region under consideration is Rl, then M,j ^^^e 360x100 with n equal to 360 
and m equal to 100. The above equation gives us the average of all the pixels for the red 
channel. Thus the average color for particular region would now be a triplet, 

JST AVAILABLE COPy 



Rave ^ \Rmi*Rgreen*Rblue\ 

The same procedure is repeated for all the regions and for all the channels within each 
region. 

Next in order to set the lights, a mapping transformation needs to be performed between 
the TV and light units. This is achieved via a standard set of equations that take as input 
the measured color primaries from each LED unit. The color primaries for the red, green, 
blue and the reference white color components are acquired by using a color 
spectrometer. Once the primaries are obtained, the transformation process is as follows: 

(a) Given a set of chromaticity (red, green and blue primaries) co-ordinates and 
the reference white, compute the transformation matrix for mapping the 
average color information onto the XYZ color gamut space for both the FLAT 
TV as well as the LED units. This gives us two set of equations : 

[X; Y; Z]=Mi * [R;G3] for Flat TV 

[X; Y; Z]=M2 * [R';G'B'l for LED's 

(b) The mapped RGB values for flie light units could be found by solving the 
following: 

[R';G';B'] ^ M2 ' * Mj * [R;G3] 

In steps (a) above, (R; G; B] corresponds to the triplet which is nothing but the computed 
average color information for a particular region for all channels. The general method for 
computing the matrix M is shown below: 

Given the chromaticity coordinates of an RGB system (Xr,yr), (xg,yg) and (xb,yb) and the 
white point (xw,yw). fl»e method to compute the 3 x 3 matrix for converting RGB to XYZ 
is as follows: 

[XYZ\ = [RGB][M] 



where 
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The above method is used for obtaining Mi and M2 and [R';G';B'] by following st§p (b) 
above. Thus [R';G';B*] is the transfonned color information for a particular region. The 
same process is repeated for obtaining [R';G'-,B'l for each of the 6 regions. The 
transformed color information is then sent to the light units so that they could be 
triggered. Please note that the whole process is repeated for all the frames (25) in each 
second. It is also important to note that the width of each region could be varied and the 
number of regions in the frame could also be varied. As an example, instead of usmg 6 
regions, one could use only 4 regions as well In such a case, the transformed color 
information for the upper region could be sent to both the LED panels located at the top 
of the TV. Furfliermore, the solution discussed above could be realized in software or via 
a programmable hardware platform such as EPLD, etc. 



INVENTION DISCLOSURE (continued) 



Sub-light 




Ught speakers 



Centre Ught 



Ught speakers 



the above figure there are 1 1 independently controllable LED lighting units. There are four tight speakers, one unit under 
3 couch ('Sub-light') and 6 units on the centre-llghL The centre-light is a little bit special, in the way it is set-up. 

Light unit 1 Light unit 2 

I I 1 I 

II II, 
Light unit 6 j | I 1 Light unit 3 
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Light unit 5 



Light unit 4 



has 6 independently controlled, light units at the four sides of the Flat TV, All the 1 1 units take one RGB coordinate from 
e corresponding color space. 



le following general steps are followed so that the appropriate light speakers are set depending upon the content that is 
rently being watched: 

(a) Acquire the video signal and the tuning information from the TV 

(b) Extract color infonnnation from the content (frames) that is cunrenUy being played 

(c) Map the color information onto the LED speakers RGB space 

(d) Transmit the RGB coordinates to the light speakers so as to turn them on with the required light setting 

steps, (a) and (b) are straightforward, they are not described below. Regarding step (b), each frame of the video in . 
estion is split up into individual frames. For each frame, 6 non-overlapping borders are defined, each with a width of 
roximately 50 pixels. From each such border, we average all the pixels to get an average color for that border. One 
mple of an image where the color extraction Is perfonmed is shown below: 
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INVENTION DISCLOSURE (continu d) 




L in order to set the lights, a mapping transformatior, needs to be per^^^^^^^^^^ and ligM 

3 unit. The colour 

hce the primaries are obtained, the transformation process is as foliows: 
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INVENTION DISCLOSURE (continued) 

(a) Given a set of chromaticlty (red. green and blue primaries) co-ordinates and the reference white, compute the 
^ ' Ja^rrrSatiS rSalTfor mapping the average colour lnfom«tion onto the XYZ colour gamut space for both 

the FLAT TV as well as the LED units. This gives us two set of equations : 

rx; Y; ZJ=Mi * IR;6:B] for Flat TV 

P<- Y- Zl=l^ * [R'lG'Bl for LED's 

(b) The mapped RGB values for the light units could be found by solving the following: 

[R';G';B1 = Mz^ * M, * IR;G:B] 
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